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Abstract 

The Abeles model of cortical activity assumes that in absence of stimula- 
tion neural activity in zero order can be described by a Poisson process. Here 
the model is extended to describe information processing by synfire chains 
within a network of activity uncorrelated to the synfire chain. A quantitative 
derivation of the transfer function from this concept is given. 

Two seminal concepts were introduced by Abeles A quantitative model 

for uncorrelated activity in the cortex in absence of external stimulation, and the 
concept of the synfire chain, a spatiotemporal pattern of synchroneous activity of 
neurons being active in the same cortical task. 

Synchroneous spiking, as a refinement of averaged firing rates, has been used 
as an equivalent mathematical basis for neural models [UE]. The experimental 
and theoretical aspects of synfire chains remain a field of active research jS] El and 
also provide a conceptual basis for neural computing architectures This paper 
analyzes the extension to formulate processing and propagation of information in 
such a network. 

1 The Abeles model of cortical activity 

The model of uncorrelated cortical activity given by Abeles pQ, here referred to 
as Abeles Model, is a direct approach to understand why randomly firing by self- 
excitation can be a stationary and robust firing mode in a neural network. The 
underlying experiments are interpreted in the following way: Even if the cortex is 
not excited by sensory input, the neurons are firing randomly (Poisson process) 
and excite each other. Obviously, this is to be interpreted as a "ground state" of 
the cortical network. An interesting question is whether random firing is a stable 
mode of a network or not. Because 99% of the inputs to the cortex are coming 
from the same or other cortical areas [5], we shall at first neglect the 1% (sensory) 
input and therefore consider a network with 100% feedback. 
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2 Definition of the Abeles model 

The defining assumptions to the Abeles Model are pQ: 

(i) Each postsynaptic potential has the shape of a falling exponential (for t > 0): 

(+A)e~*/ T for excitatory inputs, 

or, 

(— A)e~ l / T for inhibitory inputs. 

This assumption does not only include an idealization of the waveform, it 
also includes that the values of synaptic strength A and the time constants 
t are the same for all neurons. 

(ii) All postsynaptic potentials sum up in a linear fashion giving the intracellular 
potential; the neuron generates a spike if the intracellular potential reaches 
a threshold T. 

(iii) All neurons are firing independently This, however, is eqivalent to: No in- 
formation is processed. 

(iv) Each neuron has N synaptic inputs which can be excitatory or inhibitory in 
any proportion. 

(v) The neurons fire at an average rate of A spikes per second. 



3 The self-consistence equation for the average 
firing rate 

For high rates of inputs, the input spikes add up to nearly random fluctuations 
of the intracellular potential; the probability density of the intracellular poten- 
tial therefore is Gaussian. This means: The firing rate of a cell is proportional to 
the probability for the intracellular potential to be above threshold: 

1 K f 00 * 2 K f°° 2 

A = = ■ / e'^dx = -!=• e~ y dy (1) 

where K is an unknown constant and <j 2 is the variance of the intracellular poten- 
tial, which can be calculated as follows: 

Each postsynaptic potential contributes a variance of 



/•OO 

/ ({±A)e~ t/T ) 2 dt = A 
Jo 



2 _ 

2' 



Nota bene, excitatory and inhibitory connections here contribute equally. 

The independent linear superposition of N ■ A spikes (per second) gives the 
total variance 

<7 2 = (iVA).(A 2 I), 
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or 



.4 



<7 




(2) 



This means: For random firing at a constant average firing rate we have to satisfy 
a self-consistence-equation 



which still has K and T/A as free parameters to be fitted to the experimental data. 
Abeles' estimation for T/a is as follows: If the neuron fires at a rate A and each 
spike is generated if the membrane potential is approximately 1ms (« 0.4t) above 
threshold, the probability of the intracellular potential for being above threshold 
is approximately A • 1ms = 0.005, which is numerically equivalent to T/a being 
2.58. Therefore only one parameter (K) is free, it can be evaluated by solving 
equation © for K. 

The main results of the Abeles Model are quantitative estimations of network 
parameters from realistic neurophysiological properties. Using N = 20000, A = 
5s _1 , r = 2.5ms, K = 1000s -1 , one obtains g]: 



(i) a/A = a/ 125 = 11: The variance of the intracellular potential is 11 times 

bigger than the amplitude of a single spike. 

(ii) T/A = T/a ■ a/A = 2.58 • 11 = 29: Only 29 synchroneous excitatory spikes 
will lift the membrane potential to threshold. (This is a small value com- 
pared with NX — 100000 spikes that every cell receives per second.) 

(iii) A single spike has no detectable effect on the output rate: The firing rate 
increases from 5 per second to 6.4 per second, but relaxes back to 5 per 
second with the time constant r. This causes only 0.003 extra output spikes. 

To conclude, synaptic strength seems weak for detecting a single spike, but fairly 
strong for detecting coincidence inputs. This is a consequence of the highly non- 
linear error function, which determines by Q the firing rate A. As analyzed in 
the appendix, below a critical firing rate A c random firing is unstable, so that a 
certain level of activity is required to transmit information. 

4 How can we describe processing of information? 
— Extension of the Abeles model 

As one of the fundamental assumptions of the Abeles model is the randomly firing 
of all neurons, which means that all spikes are completely uncorrelated, it is a 
priori unable to describe information transfer. 

If the number of spikes carrying the information is much less than the number 
of random spikes (N ■ X as 100000), the probability density of the intracellular 
potential can be assumed to be approximately Gaussian, so that the mechanism 
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is still the same: The fluctuations converging to each neuron raise the intracellular 
potential to threshold. Remarkably this condition does not explicitely restrict 
the correlated activity of a single neuron, so it can be involved constantly in 
information processing. 

How can we understand simple processing of information in a real network, 
whose 'ground state' is randomly firing at a rather low rate? The concept given by 
Abeles is the 'synfire chain': Groups of synchroneously firing neurons are carrying 
the information; their number must be sufficiently high (at least 10-20) to excite 
the following neurons. 

A possible quantitative description of processing of information within this 
concept is given by the model described in the remainder of this paper. The basic 
properties of the extended model ^U] are defined as follows: 

(i) All input spikes -same as in the Abeles model- are assumed to share the 
common waveform of a falling exponential, 

Xiit) = Aie~^~ to ^ T (for t > 0), which may idealize the signal through the 
axon. 

(ii) The synaptic strength, which was a constant A in the Abeles model, may be 
inhibitory (A; < 0) or excitatory (A > 0), and is assumed to have different 
values for each neuron. In general, we may assume the synaptic weights also 
to be time-dependent, so that synaptic plasticity can be described. However, 
this time-dependence takes place on a much larger time-scale than the spike 
dynamic. 

(iii) All postsynaptic (episynaptic) potentials are assumed to sum up to the intra- 
cellular potential: 

I{t) =Y,A iXi {t). (4) 

i 

(iv) In addition to the Abeles Model we consider synchroneous and random inputs 
seperately: 

i(t) = + S A ^)- ( 5 ) 

*(sjmc) i(a B ync) 

As the number of randomly firing inputs is large, the difference in synaptic 
strength will not disturb the Gaussian distribution, and we can write for the 
second sum 

A ]T Xi (t). (6) 

l (asy»c) 

This is the same property as in the Abeles Model, although the firing rate 
may have a slightly different value. 

For the synchroneous inputs, we now only consider one group of firing neurons, 
so all these inputs have the same to, so we can assume to = 0, and we have, writing 
Xi(t) = Xi ■ e~*/ r : 

J2 AiXi(t)= J2 A i X i -e-V T = e-V- t °V T £ AX t , (7) 

i(sync) l(sync) i(sync) 
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where the Xi are 'digital' values (0 for no spike, 1 for a spike correlated with the 
synfire chain) . Hence we can interprete the synchroneous inputs converging to the 
cell as a time-dependent lowering of the potential threshold T : 

I(t)-e-V T AiX t =A Y, ( 8 ) 

i( ay „c) .(..y»=) 

Therefore, the firing rate is given by (all sums in the following text are sums only 
over the synfire chain inputs): 

Ht) = -tz= IcT-^m ( 9 ) 



where Xi (t) = Xi ■ e l l T . We shall write for the input sum: 

X:=Y^- (10) 

If we ask: What is the total number of extra spikes, generated by an input 
X 7^ 0, i.e., AA(t) := \x=£o{t) — \x=o(t)7 - We have to integrate the firing rate, 



,oo K ,00 

/ A\(t)dt=-= di 



dye y — / dye 



(11) 



but this expression counts all extra spikes from t — to t — oo. However, if the 
output shows too much time delay, it will not be correlated to the synfire chain 
any more. As the time constant of the exponential is r, we only take into account 
the outputs between t — and t — At, where At is a time constant which may 
have a similar or smaller value than r. 

So the average number of correlated output spikes (y) to a given input X is given 
by: 

TV- pAt rOO 

{y{x)) = wJ, dt Lr- dye ~ y2 - (12) 

Here we have not subtracted the accidental output spikes, for their value is finite 
and rather small in this short time interval. For X — > (— oo) the average output 
vanishes, which is the limit of strong inhibitory inputs. For X — > (+oo), which is 
equivalent to strong excitation, we obtain: 

lim (y(X)) = dt dye^ 2 

x ^°° V2tt Jo J-oo 

K f At , _ K 



dtV5F=-=-A*. (13) 

Z7T Jo V £ 

If we choose our free parameter At := y/2/K, the function f(x) := (y(X)), as 
defined by equation i|12|) , is a function of sigmoid type and describes the probability 
that an output spike is generated. For X — we have the probability of 0.005, 
which is the probability of accidental output spikes. 
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We recognize this result as the McCulloch-and-Pitts Neuron Model, but 
in a fairly new light: Patterns of synchroneously firing neurons can be transferred 
and processed in a quasi-digital manner even in a randomly firing network, and the 
fluctuations are necessary to understand the sigmoidal character of the response 
function. 

5 Conclusions and Outlook 

Within the framework based on the activity model and the concept of synfire 
chains, it has been shown how processing of information can be described quanti- 
tatively. Considering correlated and uncorrelated neural activity seperately, it is 
possible to describe information processing by synfire chains through a network of 
(in ground state) randomly firing neurons in a quantitative manner. 

The crudest idealizations concern the waveform of the spikes. The stochas- 
tic description of the firing process and the representation of 'one bit' by more 
than one neuron are essential in the network for error-tolerance and the ability to 
generalization. 

For synchroneously firing groups of neurons the 'quasi-digital' McCulloch-and- 
Pitts neuron Model is valid; the fluctuations of the other neurons determine the 
input-output characteristic to be sigmoidal. 

The extended model can be generalized in a straightforward manner to describe 
also inhibitiory synapses and spatio-temporal aspects of real networks by use of 
(on larger time-scales) time-dependent values Ai (t) of synaptic strength. 
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Appendix: Stability analysis of the Abeles model 

We now investigate whether the fixed point satisfying the self-consistence-equation 
is stable or instable. Although we do not know the exact dynamical properties 
of the network, we can answer this question. A small change in A will lead to a 
change in cr, the variance of the intracellular potential, where er(A(t), t) is given by 
||2J • The changed variance of the intracellular potential will cause a change in the 
firing rate, given by Q. However, this will need a certain delay At, so that the 
stationary equation has to be modified to the iterative expression 

X(a(t),t + At) = -=- e^dy. (14) 

Therefore we can approximate the real dynamics by the iteration 

\(\(t),t + At) = -==- e~ y2 dy (15) 



A^/NXtt)T/2 

and we obtain the answer to an increase of A by the amount of AA : 

AA(f + At) = A(cx(A(t) + AA), t + At) - X(a(X(t)), t) 
dX(a(X(t)),t) da(X(t),t) 

- &W) mr { h 

which means that every iteration stretches AA by the factor 

AX(t + At) dX(a(X(t)),t) da(X(t),t) 

a{x) = Ax(t) = —^t) awr- { ] 

Since 



^(Ay/NX^/2) = and 



JLfJL r e ~v 2 dv) = _^(_ e -(^) 2 ) . (-L) 

a{t) 

we obtain „ 1 m 

h ' T -e-^) 2 . (17) 



A 2V2tt cr 

For sufficiently small A A the iteration values A^ are close to the start value Ao, so 
that the Liapunov exponent of the iteration is given by L = ln|o;(Ao)|. Obviously 
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the fixed point, which is assumed to represent a 'ground state' of randomly firing, 
is a stable one if and only if the Liapunov exponent is negative, which means 
that | a | < 1. Using the experimental values given by Abeles for the cortex of the 
cat, T/ct = 2.58, K = 1000s -1 , and A — 5s~ 1 , we obtain the Liapunov exponent 
L = —2.02 or a = 0.13, which is much less than 1. In this fixed point the network 
gives strong damping to both fluctuations and external stimulus. This includes 
also sufficient stability of the 'Randomly Firing Mode': Neither a fade-out nor a 
collective 'explosion' of the firing can be generated by small perturbations. To 
understand the effects of strong perturbations, we will take a short view on the 
stability function a(T/a). Using equation 1)17(1 . we have to remember that X/K is 
a function of T/ct, so that we can use the expression (x := T/a) : 

-e~ x2 

= r oo 2 -5 , ■ (18) 

Jx e ' v d y 

Two limiting cases can be considered: For x — ► 0, which is the limes of very 
high firing rates, a(x) is asymptotic to x/^/n, so that a(x) decreases to zero. 
This expresses the damping of avalanche effects. For x — > oo^ which is the limes 
of very low firing rates, the integral is asymptotic to ^a~ x , therefore a(x) is 
asymptotic to x 2 . As a(x) is continuous, there must exist a critical firing rate 
A c , where a(A c ) = 1. It is the point where the Liapunov exponent changes its 
sign. If the firing rate is higher than A c , we still have damping, same as in the 
ground state itself. If the firing rate is lower than the critical value, the cortical 
feedback amplifies any fluctuations of the firing rate, so that the fluctuations lead 
to a fade-out of the network. To conclude, if the firing rate is lower than a critical 
firing rate A c , randomly firing cannot be a stable mode of a neural network. 



